<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8"/>
<title>符号学习简介-01绪论</title>
<meta name="author" content="(戴望州)"/>
<style type="text/css">
.underline { text-decoration: underline; }
</style>
<link rel="stylesheet" href="style/js/reveal.js/dist/reveal.css"/>

<link rel="stylesheet" href="style/js/reveal.js/dist/theme/nil.css" id="theme"/>

<link rel="stylesheet" href="style/css/hal9001.css"/>
<script type="text/javascript" src="style/js/mathjax/tex-mml-chtml.js"></script>
<script type="text/javascript" src="style/js/reveal.js/plugin/chalkboard/plugin.js"></script>
<link rel="stylesheet" href="style/js/reveal.js/plugin/chalkboard/style.css">
<script type="text/javascript" id="MathJax-script" asyncsrc="https://cdnjs.cloudflare.com/ajax/libs/mathjax/3.2.0/es5/latest?tex-mml-chtml.js"></script>
<script type="text/x-mathjax-config">MathJax.Hub.Config({"HTML-CSS": { scale: 100}, tex2jax: {inlineMath: [['$','$'], ['\\(','\\)']], processEscapes: true}});</script>
</head>
<body>
<div class="reveal">
<div class="slides">
<svg style="display: none">
  <defs>
    <marker id="arrow-red" viewBox="0 0 10 10" refX="5" refY="5" markerWidth="3" markerHeight="3" orient="auto-start-reverse">
      <path d="M 0 0 L 10 5 L 0 10 z" fill="#CC9393" />
    </marker>
    <marker id="dot-red" viewBox="0 0 10 10" refX="5" refY="5" markerWidth="2" markerHeight="2">
      <circle cx="5" cy="5" r="5" fill="#CC9393" />
    </marker>
    <marker id="arrow-blue" viewBox="0 0 10 10" refX="5" refY="5" markerWidth="3" markerHeight="3" orient="auto-start-reverse">
      <path d="M 0 0 L 10 5 L 0 10 z" fill="#8CD0D3" />
    </marker>
    <marker id="dot-blue" viewBox="0 0 10 10" refX="5" refY="5" markerWidth="2" markerHeight="2">
      <circle cx="5" cy="5" r="5" fill="#8CD0D3" />
    </marker>
  </defs>
</svg>

<section id="slide-title" style="height:100%">
<div class="flex-start" style="width:100%;height:100%">
  <div class="flexbox">
    <img src="../imgs/nju_light.svg" style="width:128px;box-shadow:none;margin-left:auto" />
  </div>
  <div class="talk-title">
    <h1 class="no-toc-progress" style="margin-top:10px">符号学习简介</h1>
    <div class="talk-subtitle">
    <p style="font-size:3.0rem;text-align:center">
    绪论
    </p>
    </div>
  </div>
  <div class="keyboard-usage">
    <p>(Press <code>?</code> for help, <code>n</code> and <code>p</code> for next and previous slide)</p>
  </div>
  <br />
  <div class="talk-author" style="font-size:2rem">
    <b>戴望州</b><br/>
    <p class="org-center" style="font-size:.9em">南京大学人工智能学院<br />
    <span class="talk-date", style="font-size:.8em">2022年-春季</span></p>
    <a style="font-size:.7em" href="https://daiwz.net">https://daiwz.net</a>
  </div>
</div>
</section>

<section>
<section id="slide-org50e929d">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h2 id="org50e929d">课程简介</h2>
<p>
<img src="../imgs/01/venn.svg" width="50%" style="box-shadow:none;margin:20px auto;margin-bottom:30px;float:none;margin-top:-3.5%"/>
</p>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-orgea0379a">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h3 id="orgea0379a">课程安排</h3>
<p>
<div class="org-left" style="font-size:2.5rem" id="" data-fragment-index="">
<b>授课</b>：戴望州（daiwz@lamda.nju.edu.cn）
</div>
<br \>
<div class="org-left" style="font-size:2.5rem" id="" data-fragment-index="">
<b>时间</b>：32学时（周二下午7、8节）
</div>
<br \>
<div class="org-left" style="font-size:2.5rem" id="" data-fragment-index="">
<b>考核</b>：课堂报告+大作业（暂定）
</div>
<br \>
<div class="org-left" style="font-size:2.5rem" id="" data-fragment-index="">
经验不足，<font color="#CC9393" style="font-size:;font-weight:700">请多多反馈</font>
</div>
</p>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-org8e323fc">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h3 id="org8e323fc">课程目标</h3>
<p>
<div class="" style="width:75%;font-size:3rem;margin:0 auto" id="" data-fragment-index="">
<b>『俱往矣，数风流人物，还看今朝。』</b>
</p>
<p class="org-right" style="font-size:2.5rem">
——<i>《沁园春・雪》</i>
</div>
</p>

<p>
<font color="#8CD0D3" style="font-size:;font-weight:700">回顾符号学习的发展史，展望机器学习的未来。</font>
</p>

<p>
具体而言，尝试回答以下几个大问题：
</p>
<ol style="font-size:2.5rem;line-height:4rem;">
<li class="fragment appear">符号主义<b>凭什么</b>和联结主义分庭抗礼？</li>
<li class="fragment appear">纯符号学习<b>为什么曾经一蹶不振</b>？</li>
<li class="fragment appear">为什么知识图谱、神经—符号学习<b>重新崛起</b>？</li>
<li class="fragment appear"><b>符号学习</b>未来的出路在何方？</li>

</ol>

<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
</section>
<section>
<section id="slide-org2519dba">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h2 id="org2519dba">符号学习・绪论</h2>
<p>
<div class="org-left" style=" margin-left: 45%;margin-top: -5%;" id="" data-fragment-index="">
</p>
<ol>
<li><font color="#8CD0D3" style="font-size:;font-weight:700">为什么？</font></li>
<li>是什么？</li>
<li>怎么做？</li>

</ol>
<p>
</div>
</p>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-org69950b9">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h3 id="org69950b9">什么是智能？</h3>
<p>
<img src="../imgs/01/monolith_2001.jpg" width=" 80%" style="box-shadow:none;margin:20px auto;margin-bottom:30px;float:none;"/>
</p>
<p class="org-right" style="font-size:1.5rem;margin-top:-3%;margin-right:10%">
Credit: <i>2001: A Space Odyssey</i>
</p>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-orgcf6a3fb">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h4 id="orgcf6a3fb">什么是智能？</h4>
<p>
<img src="../imgs/01/Skinner_box_scheme.svg" width=" 55%" style="box-shadow:none;margin:20px auto;margin-bottom:30px;float:none;margin-top:-3.5%"/>
</p>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-orgeac1d54">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h4 id="orgeac1d54">什么是智能？</h4>
<p>
<img src="../imgs/01/Raven_Matrix.svg" width="55%" style="box-shadow:none;margin:20px auto;margin-bottom:30px;float:none;margin-top:-3.5%"/>
</p>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-org7213184">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h4 id="org7213184">智能是一个复杂概念</h4>
<ul>
<li>感知（perception）</li>
<li>抽象（abstraction）</li>
<li>逻辑（logic）</li>
<li>知识（knowledge）</li>
<li>推理（reason）</li>
<li>规划（planning）</li>
<li>创造（creativity）</li>
<li>学习（learning）</li>
<li>自觉（self-consciousness）</li>
<li>……</li>

</ul>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-org03af999">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h3 id="org03af999">什么是人工智能？</h3>
<p>
<img src="../imgs/01/hal9000.svg" width="55%" style="box-shadow:none;margin:20px auto;margin-bottom:30px;float:none;margin-top:-2%"/>
</p>
<p class="org-right" style="font-size:1.5rem;margin-top:-3%;margin-right:10%">
Credit: <i>2001: A Space Odyssey</i>
</p>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-org25d44f7">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h4 id="org25d44f7">什么是人工智能？</h4>
<p>
<img src="../imgs/01/Turing_test_diagram.png" width=" 60%" style="box-shadow:none;margin:20px auto;margin-bottom:30px;float:none;"/>
</p>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-org7d5f1c2">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h4 id="org7d5f1c2">什么是人工智能？</h4>
<p>
<img src="../imgs/01/pie1.svg" width="55%" style="box-shadow:none;margin:20px auto;margin-bottom:30px;float:none;margin-top:-2%"/>
</p>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-org94be18d">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h3 id="org94be18d">人工智能研究现状</h3>
<p>
<img src="../imgs/01/pie2.svg" width="73%" style="box-shadow:none;margin:20px auto;margin-bottom:30px;float:none;margin-top:-2%"/>
</p>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-org5a6c994">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h4 id="org5a6c994">人工智能研究之<font color="#CC9393" style="font-size:;font-weight:700">“怪”</font>现状</h4>
<p>
<img src="../imgs/01/pie3.svg" width="73%" style="box-shadow:none;margin:20px auto;margin-bottom:30px;float:none;margin-top:-2%"/>
</p>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-org7211184">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h3 id="org7211184">DNN<font color="#CC9393" style="font-size:;font-weight:700">能</font>/<font color="#8CD0D3" style="font-size:;font-weight:700">不能</font>做什么？</h3>
<p>
<div class="fragment" style="" id="" data-fragment-index="1">
<span class="underline">分布式表示（distributed representation）</span>以及<span class="underline">基于它的计算</span>能/不能做什么？
</div>
<br \>
<div class="org-left fragment" style="" id="" data-fragment-index="2">
</p>
<ul>
<li>Each neuron must represent something, so this must be a <i>local representation</i>.</li>
<li><b>&ldquo;Distributed representation&rdquo;</b> means a <i>many-to-many</i> relationship between two
types of representation (such as concepts and neurons).
<ul>
<li>Each concept is represented by many neurons</li>
<li>Each neuron participates in the representation of many concepts</li>

</ul></li>

</ul>
<p class="org-right" style="font-size:1.5rem">
<a href="http://www.cs.toronto.edu/~bonner/courses/2014s/csc321/lectures/lec5.pdf" class="org-right" style="font-size:1.5rem">Geoffrey Hinton. &ldquo;Introduction to Neural Networks and Machine Learning&rdquo;</a>
</div>
</p>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-orgb3cca47">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h4 id="orgb3cca47">分布式表示</h4>
<p>
<div class="flexbox-stretch" style="" id="" data-fragment-index="">
<div class="flexbox" style="width:50%;margin-top:-2%" id="" data-fragment-index="">
<img src="../imgs/01/distributed_representation.svg " width="55%" style="box-shadow:none;margin:20px auto;margin-bottom:30px;float:none;"/>
</div>
<div class="flexbox" style="width:50%" id="" data-fragment-index="">
<img src="../imgs/01/distributed_representation2.svg " width="100%" style="box-shadow:none;margin:20px auto;margin-bottom:30px;float:none;"/>
</p>
<p class="org-center" style="font-size:1.5rem;margin:auto;margin-top:-5%;">
嵌入式表示空间（Embedding space）
</div>
</div>
</p>

<aside class="notes">
<p>
鬣狗看起来和狗很接近，但从分类学上看反而离猫更近。
</p>
<ul>
<li>骨骼、基因差异大</li>
<li>生活习性趋同</li>

</ul>
<p>
分布式表示——直觉——是可能错的。
</p>

</aside>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-org8420747">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h4 id="org8420747">分布式表示的优点</h4>
<p>
<div class="flexbox-stretch" style="height:70%" id="" data-fragment-index="">
<div class="flexbox" style="width:55%" id="" data-fragment-index="">
</p>
<ol>
<li data-fragment-index="1" class="fragment appear">学习海量样本，用参数化的嵌入式表示空间<span class="underline">逼近</span>数据真实分布
<ul>
<li>大数定律</li>

</ul></li>
<li data-fragment-index="2" class="fragment appear">学习、推理算法复杂度低，速度快
<ul>
<li>梯度下降 + 四则运算</li>

</ul></li>
<li data-fragment-index="3" class="fragment appear">无需人工输入知识<span class="fragment" data-fragment-index="5" style=""><font color="#CC9393" style="font-size:;font-weight:700">（？）</font></span>
<ul>
<li>端到端建模<span class="fragment" data-fragment-index="5" style=""><font color="#CC9393" style="font-size:;font-weight:700">（？）</font></span></li>

</ul></li>

</ol>
<p>
</div>
<div class="flexbox" style="width:45%" id="" data-fragment-index="">
<img src="../imgs/01/gpt3-meme.png" width="60%" style="box-shadow:none;margin:20px auto;margin-bottom:30px;float:none;"/>
</div>
</div>
<div class="fragment org-center" style="font-size:2.5rem" id="" data-fragment-index="4">
<font color="#CC9393" style="font-size:;font-weight:700">那么，还有必要采用符号表示（symbolic representation）吗?</font>
</div>
</p>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-orgd44ef1c">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h4 id="orgd44ef1c">分布式表示的不足</h4>
<p>
<img src="../imgs/01/fool1.png" width="90%" style="box-shadow:none;margin:20px auto;margin-bottom:30px;float:none;margin-top:10%"/>
</p>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-orge079581">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h4 id="orge079581">分布式表示的不足</h4>
<p>
<img src="../imgs/01/fool2.jpeg" width="80%" style="box-shadow:none;margin:20px auto;margin-bottom:30px;float:none;"/>
</p>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-orgf206355">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h4 id="orgf206355">分布式表示的不足</h4>
<p>
<img src="../imgs/01/fool3.gif" width="70%" style="box-shadow:none;margin:20px auto;margin-bottom:30px;float:none;"/>
</p>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-org2331785">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h3 id="org2331785">为什么我们不会这样？</h3>
<p>
<div class="fragment org-center" style="" id="" data-fragment-index="1">
认知科学中的猜想：人的认知分为<font color="#CC9393" style="font-size:;font-weight:700">系统I</font>和<font color="#8CD0D3" style="font-size:;font-weight:700">系统II</font>。<font color="#8CD0D3"><small>[Kahneman, 2011]</small></font>
</div>
<div class="fragment" style="" id="" data-fragment-index="2">
<img src="../imgs/01/sys1_sys2_example.png" width=" 80%" style="box-shadow:none;border: 20px solid #FFFFFF;margin:20px auto;margin-bottom:30px;background-color:#FFFFFF;float:none;"/>
</p>
<p class="org-center">
视觉上的例子
</div>
</p>
<aside class="notes">
<ol>
<li>第一堆和第三堆谁的方块多？</li>
<li>第一堆和第二堆谁的方块多？</li>

</ol>

</aside>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-org7910cf7">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h4 id="org7910cf7">系统I、系统II</h4>
<p>
你能多快判断出以下命题的正误？
</p>
<ol>
<li class="fragment appear">\(1+1=2\)是对的。</li>
<li class="fragment appear">窗外的树有些是绿色的。</li>
<li class="fragment appear">\(\bigcirc\bigcirc\bigcirc\bigcirc\bigcirc\longleftarrow\)这里有5个圈。</li>
<li class="fragment appear">\(\bigcirc\bigcirc\bigcirc\bigcirc\bigcirc\bigcirc\bigcirc\bigcirc\bigcirc\bigcirc\bigcirc\bigcirc\bigcirc\bigcirc\bigcirc\bigcirc\bigcirc\longleftarrow\)这里有18个圈。</li>
<li class="fragment appear">若\(p\rightarrow q\)且\(q\rightarrow r\)，那么\(p\rightarrow r\)。</li>
<li class="fragment appear">\(1+\frac{1}{4}+\frac{1}{9}+\cdots+\frac{1}{n^2}+\cdots=\frac{\pi^2}{6}\)。</li>
<li class="fragment appear">如果教室里有一百只大象，那么我的符号学习课就拿能满分。</li>
<li class="fragment appear">“我只给自己不理发的人理发，所以我可以给自己理发”。</li>
<li class="fragment appear">乌克兰在一年之内应该会打仗。</li>
<li class="fragment appear">\(P= NP\)是错的。</li>

</ol>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-org7151a70">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h4 id="org7151a70">系统I、系统II</h4>
<p>
<div class="flexbox-stretch" style="height:70%;margin-top:5%;align-items:start" id="" data-fragment-index="">
<div class="flexbox" style="width:45%" id="" data-fragment-index="">
<font color="#CC9393" style="font-size:;font-weight:700">系统I：</font>
</p>
<ol>
<li>直觉思维、一步到位</li>
<li>大量训练实现肌肉记忆、熟能生巧</li>
<li>速度快、几乎不消耗注意力</li>
<li>失败时放弃并转向系统II</li>

</ol>
<p>
</div>
<div class="flexbox" style="width:45%" id="" data-fragment-index="">
<font color="#8CD0D3" style="font-size:;font-weight:700">系统II：</font>
</p>
<ol>
<li>程序思维、逐步推理</li>
<li>必须依赖背景知识、举一反三</li>
<li>速度慢、消耗大量注意力</li>
<li>经常（盲目）相信系统I提供的信息</li>
<li>过于困难时放弃并转向系统I</li>

</ol>
<p>
</div>
</div>
</p>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-org55d87e2">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h3 id="org55d87e2">“下一代深度学习”</h3>
<p>
<img src="../imgs/01/bengio_next_dl.png" width="80%" style="box-shadow:none;margin:20px auto;margin-bottom:30px;float:none;"/>
<div class="flexbox" style="width:45%" id="" data-fragment-index="">
</p>
<p class="org-right" style="margin-right:5%;margin-top:-2%;font-size:medium">
<a href="https://www.youtube.com/watch?v=FtUbMG3rlFs" class="org-right" style="margin-right:5%;margin-top:-2%;font-size:medium">Yoshua Bengio, &ldquo;From System 1 to System 2 Deep Learning&rdquo;</a>
</p>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
</section>
<section>
<section id="slide-org4742565">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h2 id="org4742565">符号学习・绪论</h2>
<p>
<div class="org-left" style=" margin-left: 45%;margin-top: -5%;" id="" data-fragment-index="">
</p>
<ol>
<li>为什么？</li>
<li><font color="#8CD0D3" style="font-size:;font-weight:700">是什么？</font></li>
<li>怎么做？</li>

</ol>
<p>
</div>
</p>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-org373ccb7">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h3 id="org373ccb7">什么是符号？</h3>
<p>
<div class="flexbox-stretch" style="margin-top:-5%" id="" data-fragment-index="">
<div class="flexbox" style="width:55%" id="" data-fragment-index="">
</p>
<ul>
<li data-fragment-index="1" class="fragment appear"><b>公孙龙</b>：离坚白</li>
<li data-fragment-index="1" class="fragment appear"><b>墨子</b>：“坚白，不相外也。”</li>
<li data-fragment-index="2" class="fragment appear"><b>毕达哥拉斯学派</b>：万物皆数</li>
<li data-fragment-index="2" class="fragment appear"><b>亚里士多德</b>：目的论、Automaton</li>
<li data-fragment-index="3" class="fragment appear"><b>莱不尼茨</b>：“精炼我们的推理的唯一方式是使它们同数学一样切实”</li>
<li data-fragment-index="3" class="fragment appear"><b>图灵</b>：通用图灵机</li>
<li data-fragment-index="4" class="fragment appear"><b>（人工）神经元的工作模式</b>：命题逻辑演算</li>

</ul>
<p>
</div>
<div class="flexbox fragment" style="width:45%" id="" data-fragment-index="4">
<img src="../imgs/01/McCulloch_Pitts_neuron.png" width="90%" style="box-shadow:none;margin:20px auto;margin-bottom:30px;float:none;"/>
</div>
</div>
</p>
<aside class="notes">
<p>
庄子：天选子之形，子以坚白鸣
</p>

</aside>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-org9682b41">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h3 id="org9682b41">符号：认知解释的词汇</h3>
<p class="org-center">
&#xf10d 知行工夫，本不可离。&#xf10e
</p>
<p class="org-right" style="font-size:1.7rem">
—— 王守仁
</p>
<p class="org-center">
&#xf10d What I cannot create, I do not understand. &#xf10e
</p>
<p class="org-right" style="font-size:1.7rem">
—— Richard Feynman
<div class="fragment org-left" style="" id="" data-fragment-index="1">
科学中，探索理解的过程是<font color="#8CD0D3" style="font-size:;font-weight:700">解释</font>：
</p>
<ul>
<li><font color="#CC9393" style="font-size:;font-weight:700">为什么</font>会发生这种现象？</li>
<li><font color="#CC9393" style="font-size:;font-weight:700">什么</font>该为此负责？</li>
<li>它是<font color="#CC9393" style="font-size:;font-weight:700">怎样</font>引起该现象？</li>

</ul>
<p>
</div>
</p>
<p class="fragment org-left" data-fragment-index="2">
<font color="#8CD0D3" style="font-size:;font-weight:700">解释</font>就是要获得<font color="#8CD0D3" style="font-size:;font-weight:700">概括</font>，而不同的<font color="#8CD0D3" style="font-size:;font-weight:700">词汇</font>体现不同的概括。
</p>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-org9fdd705">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h4 id="org9fdd705">符号：认知解释的词汇</h4>
<p>
假定你站在大街的一个角落，看到描述如下的一系列事件：
</p>
<ol>
<li>一个行人正沿着人行道走着。</li>
<li>这个人突然转身穿过街道。</li>
<li>与此同时，宜良小汽车飞快地冲着这个行人疾驰而来。</li>
<li>小汽车司机才了急刹车。</li>
<li>汽车打滑，冲向路边撞向电线杆。</li>
<li>行人犹豫片刻，走到汽车司机坐位那边，看了看车里。</li>
<li>他跑到转角处的电话亭，播了电话9和1。</li>

</ol>
<p>
请问：出了什么事？为什么行人跑向电话亭？下一步他将做什么？为什么那样做？
</p>
<aside class="notes">
<ol>
<li>词汇选择与抽象的关联：
<ul>
<li>大脑发出电信号，刺激中枢神经，传导至足部肌肉，肌肉收缩所以跑起来了</li>

</ul></li>
<li>我们不追求完整的因果关系，只要一个<b>说得通</b>的解释。（获得概括）</li>

</ol>

</aside>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-orgbdfe13d">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h4 id="orgbdfe13d">符号：认知解释的词汇</h4>
<p>
请描述一下你下课以后打算做什么。
</p>
<ol>
<li class="fragment appear">这一系列行为之间有<b>物理上的因果</b>性吗？</li>
<li class="fragment appear">这些行为<b>合理</b>吗？</li>
<li class="fragment appear">这些行为具<b>有普遍性</b>吗？</li>
<li class="fragment appear">这些行为之间的关联<b>唯一</b>吗？</li>
<li class="fragment appear">你的这些描述<b>完全准确</b>吗？</li>
<li class="fragment appear">如果<b>不借助任何符号化词汇</b>，你还能够描述吗？</li>

</ol>
<aside class="notes">
<p>
“解释”与它们无关：
</p>
<ol>
<li>因果性；2. 统计指标；3. 一一映射；</li>

</ol>
<p>
与它们有关：1.  背景知识（常识）；2. 不确定性；3. 符号表征
</p>

</aside>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-org5701b1d">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h3 id="org5701b1d">符号：认知计算的表征</h3>
<p>
一个大胆，但又不得不做的假设：<font color="#8CD0D3" style="font-size:;font-weight:700">认知是一种计算</font>
</p>
<ol>
<li class="fragment appear">“计算”具有普适性：
<ul>
<li>通用图灵机</li>
<li>\(\lambda\)演算</li>
<li>原始递归函数</li>
<li>C语言</li>

</ul></li>
<li class="fragment appear">“计算”是一种抽象过程，与承载它的物理设备无关：
<ul>
<li>大脑</li>
<li>电子计算机</li>
<li>量子计算机</li>

</ul></li>
<li class="fragment appear">我们最终希望用<b>计算</b>机实现一个认知体（弱/强人工智能）</li>

</ol>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-org817077e">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h4 id="org817077e">符号：认知计算的表征</h4>
<p>
一个大胆，但又无法避免的结论：<font color="#8CD0D3" style="font-size:;font-weight:700">认知是关于符号的计算</font>
</p>
<ol>
<li data-fragment-index="1" class="fragment appear">没有无表征的计算：包括用代码实现的DNN</li>
<li data-fragment-index="2" class="fragment appear">计算是由规则支配的过程：函数、证明、形式语言、逻辑推理</li>
<li data-fragment-index="3" class="fragment appear">所谓的黑箱——直觉、情绪乃至神经网络：输出的表征仍然是符号</li>
<li data-fragment-index="4" class="fragment appear">认知是<b>可穿透</b>的：可解释、可调试</li>

</ol>
<p>
<div class="fragment" style=" " id=" " data-fragment-index=" 4">
<img src="../imgs/01/Duck-Rabbit_illusion.jpg" width=" 40%" style="box-shadow:none;margin:20px auto;margin-bottom:30px;float:none;"/>
</div>
</p>
<aside class="notes">
<p>
关于第四点，科学与教育就是例子：纠正反疫苗论者？
</p>

</aside>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-org4bbad5e">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h3 id="org4bbad5e">符号学习的例子：程序归纳</h3>
<p>
<img src="../imgs/01/flashfill.png" width=" 50%" style="box-shadow:none;margin:20px auto;margin-bottom:30px;float:none;"/>
<div class="fragment" style="" id="" data-fragment-index="1">
</p>

<div class="org-src-container">

<pre  class="src src-shell"   ><code trim><span style="color: #93E0E3;">Concatenate</span><span style="color: #DCDCCC;">(</span>ToLower<span style="color: #BFEBBF;">(</span>Substring<span style="color: #D0BF8F;">(</span>v,WordToken,1<span style="color: #D0BF8F;">)</span><span style="color: #BFEBBF;">)</span>,
            <span style="color: #CC9393;">" "</span>, ToLower<span style="color: #BFEBBF;">(</span>SubString<span style="color: #D0BF8F;">(</span>v,WordToken,2<span style="color: #D0BF8F;">)</span><span style="color: #BFEBBF;">)</span><span style="color: #DCDCCC;">)</span>
</code></pre>
</div>
<p>
</div>
</p>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-org939f883">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h3 id="org939f883">符号学习的直观意义</h3>
<p>
通俗来讲：符号学习就是<font color="#8CD0D3" style="font-size:;font-weight:700">选择“词汇”</font>加<font color="#8CD0D3" style="font-size:;font-weight:700">寻找“解释”</font>。
<div class="flexbox-stretch" style="" id="" data-fragment-index="">
<div class="fragment flexbox" style="width:60%" id="" data-fragment-index="1">
</p>
<ul>
<li><b>“词汇”</b>：背景知识、领域特定语言（DSL）
<ul>
<li>FlashFill语言中的语法和关键字</li>
<li>开普勒第三定律\(\rightarrow\)万有引力的发现\(\rightarrow\)广义相对论</li>

</ul></li>

</ul>
<p>
</div>
<div class="fragment flexbox" style="width:40%" id="" data-fragment-index="2">
</p>
<ul>
<li><b>“解释”</b>：假设模型
<ul>
<li>FlashFill中自动合成的程序</li>
<li>从观测中总结出来的科学定律</li>

</ul></li>

</ul>
<p>
</div>
</div>
<div class="fragment" style="" id="" data-fragment-index="1">
<img src="../imgs/01/flashfill_bk.svg" width=" 70%" style="box-shadow:none;margin:20px auto;margin-bottom:30px;float:none;"/>
</div>
</p>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-org8d8420b">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h3 id="org8d8420b">符号学习的形式化定义</h3>
<p>
通过机器学习算法，从样本\(E\)中学会一个符号模型\(H\)，使得在给定背景知识\(B\)的情况下：
</p>
<div>
\begin{equation}
B\cup H\vdash E.
\end{equation}

</div>
<p>
<div class="fragment" style="" id="" data-fragment-index="1">
</p>
<ol>
<li>这里的“\(\vdash\)”是一个通用计算过程，表示“<b>有限步推出</b>”</li>
<li>\(B\)的表征形式多种多样，一般与\(H\)和\(E\)相同</li>

</ol>
<p>
</div>
</p>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-orgf55abec">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h3 id="orgf55abec">符号学习的特点</h3>
<table border="2" cellspacing="0" cellpadding="6" rules="groups" frame="hsides" style="font-size:2.5rem;margin:10%">


<colgroup>
<col  class="org-left" />

<col  class="org-left" />

<col  class="org-left" />
</colgroup>
<thead>
<tr>
<th scope="col" class="org-left">表征</th>
<th scope="col" class="org-left">分布式/向量</th>
<th scope="col" class="org-left">符号</th>
</tr>
</thead>
<tbody>
<tr>
<td class="org-left"><i>样本量</i></td>
<td class="org-left">许多</td>
<td class="org-left">较少</td>
</tr>

<tr>
<td class="org-left"><i>数据形式</i></td>
<td class="org-left">表格</td>
<td class="org-left">灵活</td>
</tr>

<tr>
<td class="org-left"><i>模型形式</i></td>
<td class="org-left">固定形式</td>
<td class="org-left">通用程序</td>
</tr>

<tr>
<td class="org-left"><i>可解释性</i></td>
<td class="org-left">较难</td>
<td class="org-left">较简单</td>
</tr>

<tr>
<td class="org-left"><i>知识迁移</i></td>
<td class="org-left">较难</td>
<td class="org-left">较简单</td>
</tr>

<tr>
<td class="org-left"><i>复杂度</i></td>
<td class="org-left">较低</td>
<td class="org-left">较高</td>
</tr>
</tbody>
</table>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
</section>
<section>
<section id="slide-org941be5a">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h2 id="org941be5a">符号学习・绪论</h2>
<p>
<div class="org-left" style=" margin-left: 45%;margin-top: -5%;" id="" data-fragment-index="">
</p>
<ol>
<li>为什么？</li>
<li>是什么？</li>
<li><font color="#8CD0D3" style="font-size:;font-weight:700">怎么做？</font></li>

</ol>
<p>
</div>
</p>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-org166b6ad">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h3 id="org166b6ad">路径图</h3>
<p>
<img src="../imgs/01/roadmap.svg" width="75%" style="box-shadow:none;margin:20px auto;margin-bottom:30px;float:none;margin-top:-2%"/>
</p>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-org4ca9879">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h3 id="org4ca9879">参考书目</h3>
<p>
<b>命题规则学习、归纳逻辑程序设计</b>：
</p>
<ol>
<li>周志华. <i>《机器学习》</i>. 清华大学出版社.</li>
<li>Johannes Fürnkranz, Dragan Gamberger and Nada Lavrač. <i>Foundations of Rule Learning</i>.
Springer.</li>
<li>John Wylie Lloyd. <i>Foundations of Logic Programming</i>. Springer.</li>

</ol>

<p>
<b>概率归纳逻辑程序设计、统计关系学习</b>：
</p>
<ol>
<li>Luc de Raedt, Paolo Frasconi, Kristian Kersting and Stephen Muggleton.
<i>Probabilistic Inductive Logic Programming</i>. Springer.</li>
<li>Lise Getoor and Ben Taskar. <i>Introduction to Statistical Relational Learning</i>.
MIT Press.</li>

</ol>

<p>
<b>神经—符号学习</b>：
</p>
<ol>
<li><font color="#CC9393" style="font-size:;font-weight:700">New!</font> Pascal Hitzler, Md Kamruzzaman Sarker. <i>Neuro-Symbolic
Artificial Intelligence: The State of the Art</i>. IOS Press.</li>

</ol>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-org62d9bbe">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h3 id="org62d9bbe">会议</h3>
<p>
<img src="../imgs/01/IJCLR21.png" width="75%" style="box-shadow:none;margin:20px auto;margin-bottom:30px;float:none;margin-top:-2%"/>
</p>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
</section>
<section>
<section id="slide-orgc4cfd2b">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h2 id="orgc4cfd2b">One More Thing&#x2026;</h2>
<div class="outline-text-2" id="text-orgc4cfd2b">
</div>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
<section id="slide-org56ff197">
<div class="slide-header"><img src="../imgs/nju_light.svg" style="width:96px;box-shadow:none;position:absolute;right:0;top:0" /></div>
<h3 id="org56ff197">课堂报告（并不是每周都有）</h3>
<p>
尝试用\(x\)实现一个<b>数数模型</b>：当输入任意\(n, m\in\mathbb{N}\)时，不断输出
\(\{n+1,n+2,\ldots\,n+m\}\)。其中\(x\)为以下两种方式：
</p>
<ol>
<li>任意一种（你熟悉的）程序语言；</li>
<li>训练一个（循环）神经网络。</li>

</ol>
<p>
报告（<code>学号_姓名_报告1.pdf</code>）：
</p>
<ol>
<li>请描述你的实现方案（包括神经网络），代码or伪代码皆可。</li>
<li>请测试神经网络的性能（关键：训练样本量、序列长度、训练样本区间）</li>
<li>并讨论：
<ul>
<li>你的程序用到哪些背景知识？它们都是必须的吗？</li>
<li>你的神经网络性能应该如何提升？</li>

</ul></li>

</ol>
<p>
Deadline：3月4日23:59
</p>
<div class="slide-footer"><hr style="border-color:var(--zenburn-white)"><div class="flexbox-stretch"><h6>符号学习</h6><h6>绪论</h6><h6>https://daiwz.net</h6></div></div>
</section>
</section>
</div>
</div>
<script src="style/js/reveal.js/dist/reveal.js"></script>
<script src="style/js/reveal.js/plugin/markdown/markdown.js"></script>
<script src="style/js/reveal.js/plugin/notes/notes.js"></script>
<script src="style/js/reveal.js/plugin/search/search.js"></script>
<script src="style/js/reveal.js/plugin/zoom/zoom.js"></script>


<script>
// Full list of configuration options available here:
// https://github.com/hakimel/reveal.js#configuration
Reveal.initialize({
plugins: [RevealMarkdown, RevealNotes, RevealSearch, RevealZoom, RevealChalkboard],
history:true,fragmentInURL:true,margin:0.04,minScale:0.5,maxScale:2.5,width:1280,height:960,
mouseWheel:true,keyboard:{37: function() {Reveal.navigatePrev();},
38: function() {Reveal.navigatePrev();},39: function() {Reveal.navigateNext();},
40: function() {Reveal.navigateNext();},}, slideNumber:true,
center:false, display: 'block',
transition: 'fade', transitionSpeed: 'fast',
chalkboard: { boardmarkers: [ { color: '#CC9393', cursor: 'url(' + path + 'img/boardmarker-red.png), auto'}, { color: '#8CD0D3', cursor: 'url(' + path + 'img/boardmarker-blue.png), auto'}, { color: '#FFFFEF', cursor: 'url(' + path + 'img/boardmarker-black.png), auto'} ] },
});

</script>
</body>
</html>
